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An  exposition  of  the  simplex  computation  for  transportation 
type  problems. 
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HITCHCOCK  TRANSPORTATION  PROBLflC 

j 

I 

!  D.  R.  Fulkerson 

The  transportation  problem  was  first  formulated  by  F.  L. 
Iltchcock  £l?]  In  19^1;  he  also  gave  a  computational  procedure, 

j 

much  akin  to  the  general  simplex  method,  for  solving  the  problem. 

1 

Independently,  during  World  War  II,  T.  C.  Koopmans  arrived  at 
the  same  problem  In  connection  with  his  work  as  a  member  of  the 
Joint  Shipping  Board.  The  problem  Is  thus  frequently  referred 

, 

to  as  the  Hltchcock-Koopmans  problem. 

Mathematically  the  problem  has  the  form 

♦ 

( 

(l)  minimize  £  Z 

i  1-1  J-l  ( 

$ubject  to  the  constraints 

j 

(2a)  >  0 

(2b)  5Z  xij  *  ai  (1  •  1,  ...,  m) 

J 

(2c)  J!  xij  *  bj  ( J  »  1,  ...»  n) 

1 

where  a^,  b^,  a^ «  are  given.  Feasibility  Is  assured  by  assuming 

*1  >  0#  bj  >  0,  and  *  particular  realisation  of 

1  J 

the  problem  appears  If  we  think  of  m  sources  of  a  commodity,  the 
1  one  possessing  a<  unltB,  and  n  sinks,  the  J  one  requiring 
units,  and  Interpret  a^j  as  the  unit  transportation  cost  from 
•ource  1  to  sink  J.  Thus  the  linear  form  (l)  becomes  the  total 
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transportation  bill,  to  be  minimized  subject  to  fulfilling 
demands  at  the  sinks  from  supplies  at  the  sources.  This  inter-* 
pretation  is  a  paraphrase  of  Hitchcock's  original  statement  of 
the  problem. 

To  give  some  idea  of  the  diverse  applications  of  the 
transportation  problem,  we  have  compiled  the  following  list 
(by  no  means  exhaustive)  of  problems  which  can  be  successfully 
attacked,  either  directly  as  transportation  problems  or  by 
•ubsequent  developments  of  the  theory: 


(1)  Suppose  n  men  are  to  be  assigned  to  n  Jobs,  where 
man  i  in  Job  J  has  a  "score"  a^;  (a)  find  an  assignment  of 
men  to  Jobs  which  maximizes  the  sum  of  the  scores  [19]  ;  (b) 
find  an  assignment  which  maximizes  the  least  score  [9] . 

(2)  Consider  a  network  consisting  of  N  points  and  inter¬ 
connecting  links.  Let  a^  £  0  denote  the  supply  of  a  commodity 
at  the  1th  point,  b^  >  0  the  demand  at  the  point,  where 

a^  •  0,  and  >  0  the  unit  cost  of  shipping  from  i  to  J . 

Assuming  that  ^2  ai  "  5Z  bi»  that  any  point  can  act  as  a 
transshipment  point,  find  a  minimal  cost  transportation 
program  Ql6]  . 


(?)  Given  a  network,  let  a^j  denote  the  length  of  the 
link  from  1  to  J .  Find  a  chain  of  minimal  length  connecting 
two  given  points  [l(Q  . 

(4)  Suppose  B  -  ( b  ^  j ) ,  1*  1,  ...,  it,  J  ■  1,  ...»  n,  is 
a  given  matrix.  By  a  "walk  through  B  from  mn  to  In"  we  will 
mean  a  collection  of  elements  which  can  be  arranged  as 
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b 

j  bmn'  bl1J1'  **•'  bikJk'  I 

<  ; 

where  each  element  occurs  (in  B)  either  directly  above  or  to 

I 

the  right  of  the  preceding  one.  If  the  sum  of  the  displayed 
!  i 

members  la  the  length  of  the  walk,  find  a  walk  of  minimal 

length  [6]  . 

( 5 )  le  t  t  ^  j ,  ^  "*  1  #  •  •  • »  m »  J  m  1  #  •••#  k  •  1,  ? ,  . » •  f 

be  tieies  at  which  carriers  are  to  pick  up  loads  at  origin  i 
|  I 

for  delivery  to  destination  J.  Assuming  we  know  travel  times 

I 

between  each  origin-destination  pair,  what  is  the  minimum 
number  of  carriers  required  to  meet  the  schedule 

\ 

(6)  Suppose  given  a  network  of  N  points,  where  some 
point  acta  as  a  source  for  a  contnodity,  another  as  a  sink, 

i 

and  the  remaining  aa  transshipment  points.  If  each  link  of 
the  network  has  a  nonnegative  number  assigned  to  it,  its  flow 

I  ; 

oapacity,  find  a  maximal  flow  from  source  to  sink  [4,  5,  7,  8]  . 

(7)  Qlven  a  capacitated  network  (as  in  (6)),  let 

th 

at£  0  (b^  >  0)  denote  the  supply  (demand)  at  the  1^  point. 

i 

Under  what  conditions  is  it  possible  to  fulfill  the  demands 
from  the  supplies  ^10]  ?  Find  a  minimal  cost  transportation 
program. 

(8)  Let  B^ ,  ...,  be  subsets  of  a  given  finite  set 

E  »  {e^,  ...,  e^j.  Under  what  conditions  is  it  possible  to 

pick  out  distinct  e^,  ...»  e^  such  that  J  •  1,  ...,  n 

[10,  11]? 


I 
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(9)  Let  P  be  a  finite  partially  ordered  sat  consletlng 

of  elements  p1 ,  . ..,  p^.  A  chain  of  P  is  a  sat  of  ona  or  Bora 

distinct  p.  ,  . . . ,  p.  with  p.  >  p4  >  . . .  >  p.  .  A  sat  of 
X1  xk  *1  *2  “  xk 

disjunct  chains  covars  P  if  aach  element  of  P  belongs  to  soaa 

chain  of  tha  sat.  Find  a  Minimal  covering  of  P  [l}]  . 

t 

(10)  A  caterer  knows  that  ha  will  need  r4  >  0  fresh 

napkins  on  tha  day,  J  -  1,  n.  Laundering  normally 

takas  p  days;  however  the  laundry  has  a  higher  cost  service 
taking  q  <  p  days.  Laundering  costs  b  and  c  cents  respectively, 
and  new  napkins  a  cents,  b  <  c  <  a,  say.  How  does  the  caterer 
meet  his  needs  at  minimal  cost  [it,  17]  ? 

(11)  Olven  a  capaoltated  network  (as  In  (6))  with  source 
and  sink,  suppose  it  takas  one  unit  of  time  to  ship  from  any 
point  to  a  neighboring  point.  Maximize  the  total  flow  through 
the  network  from  source  to  sink  In  tha  first  N  time  periods. 

(12)  Olven  a  warehouse  with  fixed  capacity  b  and  an 
Initial  stock  s  of  a  certain  cosnodlty,  which  is  aubjeot  to 
known  seasonal  prloe  and  cost  variations,  what  is  the  optimal 
pattern  of  purchasing,  storage,  and  sales  [ij? 

v 

Perhaps  more  impressive,  from  a  practical  viewpoint,  then 
a  long  list  of  transportation-type  problems  is  a  recent  report 
[l8j  from  a  panel  discussion  on  MThe  Current  Uses  of  Linear 
Programming  In  American  Business"  which  states  that  out  of 
about  twenty  examples  of  tha  industrial  uses  of  linear  pro¬ 
gramming  known  to  the  panel,  more  than  half  of  these  were 
transportation  problems.  It  is  consequently  important  to  find 
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roort  efficient  ways  to  compute  such  problems  (even  though  the 

j 

•simplex  computation  to  be  dlsoussed  presently  lc  certainly 

i 

'efficient),  particularly  since  larger  and  larger  systems  are 

i 

being  considered.  (One  practical  example  reported  lately  has 
m  -  200,  n  -  >000.)  j 

Prom  a  mathematical  point  of  view,  perhaps  the  most  interest— 

i  j 

lng  distinguishing  feature  of  the  transportation  problem  is 

|  ( 

that  it  provides  an  approach  to  some  problems  which  at  first 
appear  to  be  purely  combinatorial.  Thus,  for  example,  problems 
1,  3,  4,  3#  3 1  9,  10  in  the  list  are  of  this  nature.  The 
reason  for  this,  as  we  shall  see,  is  that  in  case  the  a^  and 
bj  are  integral,  the  extreme  points  of  the  convex  polyhedron 
described  by  (2)  are  also  integral.  Stated  another  way,  this  { 
simply  means  that  fractions  are  never  encountered  in  solving 
the  problem  via  the  simplex  method.  This  characteristic,  whiefi 

♦ 

* 

makes  it  possible  to  represent  some  combinatorial  problems  as 
continuous  ones,  also  accounts  for  the  ease  of  computation  of 
transportation  problems.  While  it  is  an  impossible  task,  at 
present,  to  solve  a  general  linear  programming  problem  with 
3200  equations  and  600,000  variables,  transportation  problems 
of  this  size  are  currently  being  programmed.  Even  by  hand, 
problems  of  fairly  respectable  size  can  be  computed  in  a  few 
hours.  For  example,  L.  R.  Ford  and  I  recently  solved  (using 
a  new  algorithm  to  be  discussed  at  the  end  of  the  course)  a 
problem  with  m  •  12,  n  -  120,  involving  all  1440  variables, 
in  something  like  eight  hours. 
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1.  SIMPLEX  METHOD 

The  particularization  of  the  simplex  method  to  the  transporta— 

! 

tion  problem  was  set  forth  by  G.  Dantzig  in  a  paper  published  { 

j 

in  1951  [?] •  Since  then,  various  other  accounts  of  the  method 

1 

have  appeared  and  also  other  proposals  for  solving  the  problem, 

; have  beer,  made.  It  is  certainly  safe  to  assert  that  the  simplex 

| 

computation  is  the  one  in  widest  use  at  present. 

Before  taking  up  the  computation  7ia  the  simplex  method,  we 

shall  first  state  and  prove  some  fundamental  properties  of  the 

!  1 

| problem. 

! 

:  1 

Lemma  1.  The  problem  13  feasible  if  and  only  if  a^  2 

I  bj  >  0,  and  2  ai  -  S  bj  • 

aib1 

Proof.  If  the  condition  hold3,  then  x. ,  •  - satisfy 

—  1J  Z>i 

the  constraints. 

1 

1 

|  I 

Clearly  the  conditions  £  0,  b^  >  0  are  necessary.  Summing 
equations  (2b)  on  i,  (2c)  on  J  yields  S  ai  ■  22  xij  ■  £  bj  • 

1  i.j  j 

The  m  +  n  by  mn  coefficient  matrix  H  of  the  set  of  equations 
(2)  has  the  form 
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X11  X12  *  ’  *  xln  X21  x22  x2n  *  *  *  xml  xm2  *  *  *  xmn 


!h  - 


khere  we  have  recorded  the  variables  at  the  top  of  their 
corresponding  column  vectors  X^j .  If  wo  refer  to  the  first  m 

I 

components  of  as  its  source  components,  the  last  n  as  its  i 


th 


pink  components,  then  X^  has  1  in  its  1  source  component,  1 


,th 


In  its  J  sink  component,  and  zeros  elsewhere. 

Lemma  2.  The  matrix  H  has  rank  m  +  n  •—  1 . 

; 

Proof.  As  we  saw  In  the  proof  of  Lemma  1.  the  sum  of  the 
— 

first  m  rows  of  H  is  equal  to  the  sum  of  the  last  n,  and  hence 
rank  H  £  m  +  n  —  1 .  On  the  other  hand,  it  is  easy  to  see  that 
the  m  +  n  -  1  column  vectors  Xj  1 ,  X12»  ...,  Xln,  X?n,  ...,  XJnn 

are  linearly  Independent.  For  assume  a  linear  dependence 

* 

kUXll  +  k12X12  +  •••  +  kinXln  4  k2nX2n  +  * '  *  *  ‘Snn^nn  "  1 
lTils  vector  has  the  form  (written  as  a  row  for  convenience) 


( 


n  m 

^  kiJ'  k2n *  ***'  kmn '  kll»  k12'  *  *  *  *  kl,n-l»  ^  kiJ  ) 
J-l  l-i 


p  _Pon 


7-9-S6 

-6- 


4 


and  consequently  each  k  vanishes. 

Thus  one  of  the  sot  (2b),  (2c)  could  be  discarded,  leaving 
m  +  n  -  1  linearly  Independent  equations.  For  computational 

I 

purposes,  it  is  perhaps  better  to  retain  all  of  the  equations, 
however,  and  we  shall  do  this. 

There  are  various  convenient  ways  of  schematizing  equations 
(2b),  (2c).  We  might,  for  example,  think  of  the  array 


having  prescribed  row  and  column  sums  and  b,.  Another  waiT, 
that  of  the  original  realization  of  the  problem,  is  to  picture 
the  linear  graph  consisting  of  m  source-nodes,  n  sink-nodes, 
and  all  links  1J  joining  sources  to  sinKS 

Sources  ( 1 )  1 rks  ( J  1 


so  that,  associating  with  link  1J ,  the  1th  -ource  equation 
says  that  the  sum  of  all  variables  associated  with  limes  ema- 


n  0  rw-> 

_ -£t- 

natlng  from  i  is  a.  ,  and  similarly  for  the  sinks. 

For  hand  computation,  a  layout  sheet  In  the  form  of  an  array 
•la  commonly  used  and  la  more  convenient  than  drawing  linear  grtphs. 

i 

For  the  purpose  of  proving  theorems  about  the  problem,  however, 
we  shall  adopt  the  linear  graph  point  of  view  for  two  reasons: 

i  i 

to  take  advantage  of  some  of  the  elementary  concepts  and  results 
from  linear  graph  theory,  and  to  make  the  discussion  of  the 
■Hitchcock  problem  tie  in  more  closely  with  the  next  lecture  on 
network  problems. 

Notice  that  the  matrix  H  is  the  incidence  matrix  of  nodes  1 

i 

va .  links  of  the  graph,  that  is,  if  we  list  the  links  1J  horizon¬ 
tally,  the  nodes  vertically,  and  record  a  1  if  a  link  13  incident 
with  a  node,  zeros  elsewhere,  the  matrix  H  results.  Because  of 
the  special  structure  of  the  transportation  graph,  namely  the 

Inodes  can  be  separated  into  two  classes  (sources  and  sinks)  so 

I 

that  all  links  Join  nodes  of  the  first  class  to  nodes  of  the 
second  class,  the  0—1  Incidence  matrix  H  has  a  very  special 
property,  as  we  shall  see  later  on. 

All  we  will  need  concerning  linear  graphs  are  the  following 
hotlons.  For  the  moment,  denote  the  nodes  of  a  graph  G  by  1 , 

2,  ...,  N  and  the  links  by  unordered  pairs  of  nodes.  Then  a 
chain  is  a  set  of  one  or  more  links  that  can  be  arranged  as 
i.i2,  1^1,,  ...»  lj^jlfc  where  the  nodes  ij,  1 ^ »  •••»  iK  are 
distinct.  A  cycle  is  a  set  of  links  that  can  be  ordered  as 

^2^ v  •••»  1^ 1 1^ »  ! k 1 ^ node s  1  ^ ^  again 

being  distinct.  A  graph  is  connected  if  each  pair  of  nodes  is 


Joined  by  a  chain,  and  a  connected  graph  without  cycles  is  a 
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tree.  Equivalently,  a  tree  le  a  graph  In  which  each  pair  cf 
nodes  Is  Joined  by  just  one  chain,  since  the  union  of  two  chains 
Joining  the  same  pair  of  nodes  contains  a  cycle.  Let  G  have  L 
links  and  P  connected  pieces;  then  L  -  N  +  P,  known  as  the  cyclo— 
fr.atlc  number  of  G,  gives  the  maximal  number  of  Independent  cycles 
In  G,  where  3  set  of  cycles  Is  Independent  If  each  contains  a 
link  not  In  any  of  the  others .  Thus  any  two  of  the  three  con¬ 
ditions  (a)  G  connected,  (b)  G  has  no  cycles,  (c)  L  »  N  -  1, 
imply  the  third  and  characterize  G  as  a  tree. 

I 

Now  corresponding  to  any  basis  for  the  transportation  pro¬ 
blem,  we  may  associate  a  subgraph  of  the  full  transportation 
graph  by  deleting  those  links  corresponding  to  non— basic  variables. 
It  Is  now  easy  to  prove  the  following  fundamental  theorem,  which 
Bccounts  for  the  simplicity  of  the  simplex  computation  f_r  trans¬ 
portation  problems . 

Theorem .  A  set  of  variables  Is  a  basic  set  If  and  only  If 
Its  graph  Is  a  tree . 

Proof.  If  B  Is  a  basic  set.  Lemma  2  shows  that  B  contains 
r  4  n  —  1  variables.  Since  the  graph  Q ( B )  associated  with  B 
has  ra  +  n  node3 ,  we  see  that  condition  (c)  above  Is  fulfilled. 

We  now  verify  (b).  Notice  that  any  cycle  of  the  transportation 
graph  must  be  of  the  form 

1  '  1  1  »  1 

1^1’  12 . V  k’  °k  1  ' 

Thus,  since 

X.  -  X.  ,  +  .  .  .  ♦  X.  .  -  X.  ,  =0. 

a!*M  12° 1  k^k  LlJk 
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ft  (B)  can  contain  no  cycles.  It  is  therefore  a  tree. 

Conversely,  let  B  be  any  set  of  variables  whose  graph  G(B) 
is  a  tree.  By  (c),  B  contains  the  proper  number,  m  +  n  —  1 ,  of 
variables.  Moreover,  the  associated  column  vectors  of  H  are 
linearly  independent.  To  see  this,  locate  an  "end-node''  in  G(B) 
(i.e.  a  node  incident  with  just  one  link  of  G(B)  );  there  must 
be  at  least  two  such.  Let  this  node  be  a  source-node  1,  say, 
and  suppose  1J  is  the  link.  Then,  assuming  a  linear  dependence 

2  Kijxu  ■  °> 

ueo(B) 

1 

we  deduce  immediately  that  k-j-  j  *  0.  We  then  delete  this  node 
and  the  link  on  it,  leaving  a  tree,  and  repeat  the  procedure. 

Jt  follows  that  all  the  coefficients  of  the  assumed  linear 
dependence  vanish,  and  hence  B  Is  a  basis,  although  of  course 
hot  necessarily  a  feasible  one.  (Notice  that  Lemma  2  was  proved 
by  selecting  a  particular  subtree.) 

We  point  out  that  this  la3t  part  of  the  argument  does  not 
rely  on  e-ny  opecial  features  of  the  transportation  graph.  In 
other  words,  the  Incidence  matrix  of  nodes  V3.  links  of  any  tree 
has  maximal  rank.  Moreover,  the  argument  also  shows  that  such 
a  matrix  may  be  arranged  in  triangular  form,  rnd  indeed  gives  a 
prescription  for  doing  so. 

Corollary  1 .  Every  transportation  basis  is  triangular . 


( 


I 
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(Id)  (2c)  (lb)  (3a)  (2a)  (la) 


Corollary  2.  If  the  and  b,  are  Integers ,  so  are  the  < 
for  any  basic  solution. 


Proof .  Since  the  coefficients  In  the  equations  are  either 
0  or  1,  and  every  basl3  Is  triangular,  only  addition  and  sub¬ 
traction  are  required  In  solving  for  a  basic  solution. 

Actually  one  can  say  somewhat  more  —  the  value  of  any 
variable  In  a  basic  solution  Is  either  a  partial  sum  of  the  a^ 
rlnus  a  pirtial  sum  of  the  b  , 


o 


or  vice  versa.  Thus 


r 
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Corollary  3-  Degeneracy  In  the  simplex  computation  can 

occur  only  If  a  partial  aim  of  the  a.  equals  a  partial  sum  of 

"  ^ 

the  b , . 

We  next  turn  attention  to  the  simplex  multipliers.  Denote 
hy  «V  )  the  multiplier  corresponding  to  the  1th  source 

sink)  equation.  Then  the  equations  to  be  solved  In  evalu¬ 
ating  the  simplex  multipliers  are 

4 

(3)  «<!  +  A,  -  a1J  (lj€0(B)). 

I 

I 

Thus  we  may  think  of  assigning  a  number  to  each  node  so  that 
,the  sum  of  any  two  numbers  on  nodes  Joined  by  a  link  of  G(B)  is 
-equal  to  the  transportation  cost  for  the  Jink.  Because  one  of 
the  original  equations  Is  redundant,  (3)  determines  the  and 
ft.  only  to  within  an  additive  constant;  more  precisely.  If 
satisfy  (3),  all  solutions  are  gl  ven  by0^^  —  k,  +  k. 

Fixing  some  multiplier  at  zero,  say,  gives  a  unique  determination . 
From  Corollary  1  we  have 

Corollary  ^ .  If  the  a^j  are  Integers  and  one  of  the  multi¬ 
pliers  oL  ^  p  Is  asalgned  an  1 ntegral  value,  all  multipliers 
are  Integral . 

Let  source  1  and  slnx  J  be  Joined  by  the  (unique)  chain, 
necessarily  of  odd  length. 


1J 


J  1 1 2  , 


lu2 


"  K1k ' 


V 


In  G(B).  Then,  solving  for  the  multipliers  along  this  chain, 


< 
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we  see  that 


h 


•uj  -“‘t 

•ljj,  -  “uj  wi 


*v2  *  4lJi  Wi 


1J1 


ft 


a  1  1  a11  *  •  •  •  +  a  1  <  “a11  ~  °*1  • 
1kJ  k Jk  11“2  1"1  J1 


hence 


Corollary  5-  The  simplex  multipliers  satisfy 


c< 


1 


4-  a 


11J2 


-►  a 


where  lj1#  j^lj,  ljjp,  ••••  J^l^,  la  the  chain  joining  1 

and  J  In  C(D)  . 

The  simplex  criterion  for  optimality  of  a  basic  feasible 
solution  Is 


<4>  ®ij  '  *ij  "*1  "ft 

for  all  norv-baslc  variables  IT  eome  Bj  ,  <  0,  the  variable  , 

may  be  Introduced  Into  the  basic  set  with  a  possible  decrease 

i 

In  cost.  To  Introduce  such  a  variable,  we  need  only  look  for 
the  chain  joining  1  and  J;  this  chain,  together  with  link  1J, 
constitutes  a  cycle;  It  Is  the  only  cycle  In  the  graph  0(B)  U  ( 1 J ) . 
For  a  cycle,  as  we  have  seen,  the  associated  column  vectors  of  H 
are  linearly  dependent,  the  coefficients  of  the  dependence  being 
alternately  +1  and  -1.  Stated  another  wav,  If  tie  cycle  Is 
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and  we  denote  the  basic  feasible  solution  by  x,  thsn  a  change 
of  6  In  Is  compensated  for  by  alternately  subtracting  and 
adding  6  along  the  chain,  l.e. 


(5) 


x 


1J 


♦  % 


-  B. 


Using  Corollary  5,  It  is  clear  that  If 


Bij  *  *i;  *  “ljj  +  *i1J1 


♦  a 


^k 


<  0, 


this  ohange  results  In  a  decrease  of  05^  In  the  transportation 
cost . 

The  nee  set  of  basic  variables  results  by  taking  S  as  large 
as  possible  consistent  with  Maintaining  non-negativity  of  variables, 
1  .e. 

(6)  $  -  aln  (  x.  1  ,  x,  1  ,  . . x.  ,  )  . 

lJl  llJ2  1k*) 

Noe  It  nay  happen  *hat  the  alnlaua  In  (6)  occurs  for  more  than 
one  Index  pair.  This  situation,  referred  to  as  a  "tie”  In  the 
algorithm,  night  lead,  on  sone  future  basis  ohange,  to  a  deter- 
nlnatlon  of  ^  -  0,  l.e.  to  degeneraoy  In  the  algorltha,  and  the 
consequent  possibility  of  non-termination.  By  Corollary  3»  this 
oan  happen  only  If  a  partial  sum  of  a^  equals  a  partial  sun  of 
bj.  Viewing  Corollary  3  In  a  slightly  different  way,  we  see 
that  If  a  tie  has  occurred,  the  graph  of  the  strlotly  positive 
basic  variables  In  the  new  set  Is  disconnected,  and  thus  the 
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origlnal  problem  splits  up  Into  feasible  "sub-problems . " 

It  la  easy  to  see  from  Corollary  1  that  degeneracy  can  be 
avoided,  If  one  desires,  by  perturbing  the  a^  and  b,  as  follows: 

•i  — *  ®i  ■  *i  + 

»!  - >  ®i  -  *!  (1  >  1) 

b,  - >  bj  .  bj  +  £. 

For  t  sufficiently  small,  no  partial  sum  of  the  a|  can  equal  a 
partial  sum  of  the  b‘,  as  otherwise  we  would  have  either 
0£  »  k L  or  n£  -  k£  ,  where  1  <  k  <  n-1,  a  contradiction.  A 
value  of  S  need  never  be  specified;  when  a  tie  occurs  In  the 
original  problem.  It  can  be  resolved  by  evaluating  the  "£-part" 
of  the  solution.  Another  way  to  resolve  ties  Is  Just  to  select 
at  random  among  the  tied  alternatives.  It  Is  easy  to  see  that 
the  simplex  computation  then  terminates  with  probability  one. 

It  may  be  Instructive  at  this  point  to  re-lnterpret  the 
various  steps  of  the  simplex  computation  In  terms  of  the  array 
(instead  of  a  linear  graph)  commonly  used  for  hand  computation: 


Sinks 


Sourcss 


Ths  values  of  ths  current  basis  sst  ars  recorded  In  thalr 
approprlats  oslls  (indicated  in  ths  example  by  ths  x^  shown). 

To  ooapute  ths  multipliers  ^ @ y  assign  cK\  "  0,  say,  th'en 
soan  ths  first  row  for  baslo  sails,  computing  ths  oorrsspondlng 
fa.  and  ^2  ln  th#  •xarapls).  Than  soan  ths  columns  assoelatd 

with  nswly  computed  j ,  evaluating  a  sst  of  oC's  (0(2  *n 
sxasipls).  Contlnus  this  process  until  all  multipliers  ars 
svaluatsd.  The  next  step  Is  to  compute  all  6^  -  a^  — 
and  find  ths  most  negative  one  (assumed  to  be  ln  the  axample). 
Increasing  this  variable  to  $  causes  ths  chain  of  reaotlona  Indi¬ 
cated  by  4-  0  and  -  6  In  the  array.  Taking  4  as  large  as  possible 
(siin  (xx 1#  *22'  *44'  *35)  )  gives  ths  new  basic  feasible  solution. 
Notice  that  the  cycle  one  Is  looking  for  takes  ths  form  of  a  "rook»s 
tour”  In  ths  array.  Por  small  problems,  searching  for  a  cysls  Is 


easily  done  without  any  special  algorithm.  For  larger  problems, 
however,  one  needs  an  efficient  algorithm  for  this  search.  We 
sJ"'ll  describe  one  such,  which  might  be  referred  to  as  the  "labeling 
procedure"  [60.  nils  procedure  Is,  In  general,  an  efficient  way 
of  finding  a  chain  Joining  two  given  nodes  in  an  arbitrary  net¬ 
work,  and  will  play  an  Important  role  in  subsequent  lectures  on 

t 

network  problems  and  a  new  algorithm  for  the  transportation 
problem . 

Label  the  column  which  contains  the  variable  to  be  intro¬ 
duced  by  a  0.  say,  and  scan  the  column  for  basic  cells;  when 
one  is  found,  label  the  corresponding  row  by  the  number  of  the 
column  being  scanned;  take  any  newly  labeled  row  and  scan  It 
for  basic  cells  contained  in  unlabeled  columns ;  label  the  ccrre— 
spondlng  columns  by  the  number  of  the  row  being  scanned;  when 
these  rowB  have  all  been  scanned,  go  to  the  newly  labeled  col- 

v 

umns  and  repeat  the  procedure  (never  labeling  a  row  or  column 
which  already  has  a  label),  stopping  only  when  the  row  which 
contains  the  cell  being  introduced  has  been  labeled.  Then 
proceed,  in  that  row,  to  the  position  Indicated  by  its  label, 
and  record  —  0;  then  go,  in  the  column  reached,  to  the  position 
Indicated  by  its  label,  and  record  +  0.  Continue  this  backward 
replacement  until  the  original  column,  labeled  0,  Is  reached. 

A  labeling  which  finds  the  desired  cycle  is  indicated  at 
the  bottom  and  to  the  right  of  the  array  in  the  example. 

Por  machine  calculation,  it  la  probably  a  good  idea  to 
carry  along  a  separate  list  of  basic  cells,  sorted  perhaps  on 
both  rows  and  columns,  and  to  do  the  computation  of  the  multi— 
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pliers  and  the  search  for  the  cycle  In  terras  of  Just  this  list. 

So  far  vre  have  said  nothing  about  finding  a  starting  basic 
feasible  solution.  This  again  Is  an  easy  task.  Simply  select 
any  cell  1J  and  set 


Xj,  *  min  (a,  ,  b  , ) . 


by  bj  -  a1( 

and  select  another  cell  In  the  reduced  array.  If  x^j  •  b ,  <  a^, 
delete  the  column  and  reduce  a^  by  b,  £o  obtain  the  reduced 
array.  If  -  b<f  delete  either  the  row  or  column,  unless  there 
are  several  rows  (columns)  left  and  only  one  column  (row).  In 
which  case  a  row  (column)  Is  deleted. 

This  completes  the  discussion  of  the  simplex  computation 
for  transportation  problems . 


If 


“ 


ai  <hy 


delete  the  1th  row,  replace  b 


2.  OPTIMAL  ASSIGNMENT  PROBLEM 


As  we  have  mentioned  earlier,  the  Integrality  of  basic 
feasible  solutions  for  the  Hitchcock  problem  with  integral 
supplies  and  demands  enables  one  to  solve  some  combinatorial 
problems  by  setting  them  up  es  Hitchcock  problems.  Perhaps  the 
best  known  example  of  this  is  the  problem  of  optimal  assignment 
(la  in  the  Hat),  where  the  constraints  take  the  form 


(7) 


(1  -  1.  ....  M) 


.  M) 


(J  -  1. 


•  •  • 
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and  we  wish  to  maximize  >  a.  ,x,  , .  Since  basic  feasible  sclu- 

i  ^  1  j 

*  *  j 

tions  are  integral,  each  row  and  each  column  of  such  a  solution 
contains  a  1  and  0's  elsewhere,  and  this  describes  a  permutation 
or  assignment  of  men  to  Jobs.  Conversely,  any  permutation  matrix 
is  a  basic  feasible  solution.  Thus  an  optimal  assignment  problem 
may  be  solved  as  a  Hitchcock  problem  having  the  constraints , (?) . 

It  is  also  true  that  a  Hitchcock  problem  with  Integral 
and  b,  may  be  formulated  as  an  optimal  assignment  problem  with 

sJ 

M  -  •  The  idea  can  be  made  clear  by  considering  an  example 

(pictured  schematically  below): 


an 

■«! 

a21 

a22  | 

4 

1 

an'an 

an 

an 

al2 

an 

an 

an 

an 

a12 

a21 

a21 

a21 

a2’. 

a22 

a21 

a21 

hL 

a21 

a22 

la21 

a21 

! 

a21 , a21 

a22 

1111  1 


1 

1 

1 

1 

1 


Thus  the  1  source  is  replaced  by  sources,  each  with  unit 
supply  and  the  same  shipping  costs,  and  the  process  is  repeated 
for  the  sinks  . 

v 

?.  UPPER  BOUNDS  ON  VARIABLES 

In  addition  to  the  constraints  (2),  one  may  add  "capacity" 
restrictions 

(8)  xij  ^  c^ 

without  altering  the  character  of  the  problem,  except  that  the 
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feaslblllty  criterion  la  no  longer  simple.  Since  upper  bounds 
on  variables  will  be  dealt  with  later  on  In  the  couree  for  the 
general  linear  programming  problem,  we  will  not  discuss  the 
matter  here  In  any  detail.  Briefly,  the  situation  Is  this.  If 
Inequalities  (8)  are  rewritten  In  the  usual  way  as 

X1J  4  ylJ  "  C1J  '  ylJ  ^  C  ' 

then  one  of  y^  ,  must  be  In  any  basic  set.  Thus,  If  B 

denotes  a  basic  set,  the  pairs  1J  fall  Into  three  classes: 
those  1J  for  which  y^,£B;  those  for  which  x^,€B, 

(hence  x^  ,  -  c^,);  and  those  for  which  ,  fB,  y^jtfB 
(hence  y^j  •  c^).  The  graph  of  the  pairs  of  the  first  kind 
can  be  shown  to  be  a  tree,  and  thus  the  basis  Is  again  trian¬ 
gular  . 

4.  THE  TRANSSHIPMENT  F FOB LEW 

The  transshipment  problem  (problem  2  In  the  list)  arises 
frequently  In  practical  applications.  It  was  originally  formu¬ 
lated  and  solved  by  A.  Crden  £l^] ;  his  method  of  solution  Is 
to  add  the  "transshipment  variables"  x^  and  double  the  original 
number  of  equations,  thereby  getting  the  problem  In  the  standard 
Hitchcock  form. Instead  of  using  this  device,  we  shall  give  a 
brief  discussion  of  the  problem  directly  In  terms  of  the  given 
linear  graph. 

If  we  let  x^ ,  (l,  j  -  1,  ...,  N)  denote  the  commodity  flow 
from  node  1  to  node  j  and  assume  that  the  numbering  of  the  nodes 
Is  such  that  1,  ...,  k  are  sources,  k  +  1 ,  ...,  N  are  sinks, 
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then  the 

constraints  are 

(1C) 

53  (*M  - 

u  * 

X1J>  -  -  *1 

0 

■  1 ,  .  .  .  ,  k ) 

J/1 

I 

K 

w 

X1J)  ■  0 

(1 

•  k  1 ,  .  .  .  , 

k  +  / 

J/1 

* 

xl)>  *  bl 

(1 

*  k  +  l ,  .  .  .  , 

N) 

o 

A| 

H 

(where  variables  corresponding  to  visaing  link*  do  not  appear), 
aubject  to  which  it  Is  desired  to  minimize 


(I1)  s  aijxi j ■ 
l.J 
i/J 


Thus,  for  example,  If  the  network  Is 


the  matrix  T  of  the  linear  programming  problem  Is 


*  1 2 

*21 
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X31 
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*4  1 
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1 
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-1 
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c 
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0 
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0 

1 

-1 

1 

-1 
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Notlct  that  the  column  vector  X^  j  has  -1  In  the  posi¬ 
tion,  +1  In  the  J^h  position,  and  zeros  elsewhere.  Consequently 
the  sum  of  the  rows  of  T  vanishes,  and  rank  T  <  U  -  1 .  Just  as 
In  the  Hitchcock  problem,  we  can  exhibit  a  set  of  N  —  1  linearly 
Independent  column  vectors  of  T  (provided  the  graph  Is  connected, 
as  we  assume  to  Insure  feasibility)  by  selecting  a  spanning  sub¬ 
tree  of  the  graph  and  choosing  either  or  corresponding 
to  the  links  of  the  tree.  Indeed,  every  set  of  N  -  1  linearly 
Independent  column  veotors  can  be  exhibited  In  this  fashion,  l.e. 
the  fundamental  theorem  on  the  correspondence  of  basic  sets  of 

variables  and  trees  remains  valid.*  The  proof  Is  little  dlffer- 

th 

ent;  one  Just  observes  that  because  X.  ,  has  -1  In  the  1  compo— 

*  v. 

nent,  >1  In  the  J  ,  any  choice  of  columns  corresponding  to  a 
cycle  leads  to  a  dependency.  More  specifically,  1 f  we  orient 
the  links  of  the  cycle  C  In  the  directions  dictated  by  the 
choice  of  variables,  e.g. 


than  5D  1  «  ™  0,  where  the  -  sign  la  selected  If,  In 

1J£C 


traversing  the  cycle,  link  1J  Is  traversed  In  the  direction 


•More  properly,  a  basic  set  of  variables  corresponds  to  an 
oriented  spanning  subtree  of  the  graph,  since  the  Incidence 
matrix  T  Is  composed  of  ones,  minus  ones,  and  zeros. 
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opposite  Its  orientation,  say,  the  ♦  sl^n  otherwise. 

One  difference  between  the  transshipment  and  Hitchcock 
problems  that  should  be  pointed  out  is  ti  at  the  convex  polyhedron 
defined  by  (10)  is  unbounded.  The  assumption  a.  ,  >  C  guarantees 
a  finite  minimum  for  the  problem,  however. 

The  simplex  computation  for  tne  transshipment  problem  differs 
only  in  detail  from  the  computation  for  the  liltcrcock  problem. 

The  simplex  multipliers,  one  for  each  node,  are  found  b\  assigning 
one  of  them  an  arbitrary  value,  and  computing  the  others  along 
the  tree,  taking  account  of  the  orientation  of  the  links.  Intro¬ 
ducing  a  variable  ,  Into  a  basic  set  Is  a *al n  equivalent  to 
finding  the  chain  of  the  tree  which  tiolns  node  1  to  node  j,  and 
may  be  done  by  a  labeling  procedure. 

For  machine  computation,  one  would  of  course  not  have  a 
separate  program  for  the  transshipment  problem,  but  would  use 
Order's  approach  and  solve  an  equivalent  N  by  N  Hitchcock  problem. 
For  the  transshipment  graph  pictured  earlier,  the  equivalent 
Hitchcock  problem  is  described  b  tne  array 
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where  cells  with  costs  ♦  oo  correspond  to  missing  variables, 

has  zero  cost,  and  •  Is  a  sufficiently  large  number  (s  »  Z3  ai 
will  do). 
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